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CLAIMS: 



1 1 . A Link Packet Scheduler for each virtual lane (VL) at a given port, comprising: 

2 a N-bit counter arranged to accumulate free credits relinquished, when a data packet is 

3 removed from a receive buffer and that buffer space is reclaimed as available for data packet 

4 storage, or when a link packet is received whose Flow Control Total Bytes Sent (FCTBS) field 
5i;3 differs from actual blocks received (ABR) at the given port; 

6 Co a first comparator arranged to make comparison between accumulated free credits from 

7 j,Jf the N-bit counter and a programmable credit threshold; 

8^ a second comparator arranged to make comparison between a current buffer receive 

9;=3 utilization indicating a data storage level of the receive buffer and a programmable utilization 

io j U threshold; and 

1 1 □ a logic device arranged to track a current link state of the corresponding port, to monitor 

12 the amount of receive buffer resources from the first and second comparators and to schedule for 

13 the transmission of a link packet, via a physical link. 

1 2. The Link Packet Scheduler as claimed in claim 1 , wherein said logic device 

2 comprises: 

3 a first OR gate arranged to track whether a Link State Machine transitions into one of the 

4 Linklnitialize, the LinkArm and the LinkActive state, whether a configuration strap for enabling 
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loopback operation changes states, and whether a per-VL Link Packet Watchdog Timer expires, 
and generate therefrom a logic signal; 

an AND gate arranged to logically combine outputs of the first comparator and the 
second comparator and produce a logic signal; and 

a second OR gate arranged to logically combine the logic signals from the first OR gate 
and the AND gate and generate an indication for transmission of the link packet for the virtual 
lane (VL) on the given port. 

3. The Link Packet Scheduler as claimed in claim 2, wherein said Link Packet 
Watchdog Timer is utilized to ensure that at minimum link packets will be independently 
scheduled at least once every 65,536 symbol times in accordance with the InfiniBand™ 
specification. 

4. The Link Packet Scheduler as claimed in claim 1, wherein each of said credits is 
defined to be 64-bytes of available receive buffer space. 

5. The Link Packet Scheduler as claimed in claim 1, wherein said link packet 
contains at least a Flow Control Total Block Sent (FCTBS) field which is generated by the 
transmitter logic and is set to the total number of blocks (64 bytes) transmitted since link 
initialization, and a Flow Control Credit Limit (FCCL) field which is generated by the receiver 
logic and is used to grant transmission credits to the remote transmitter. 
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1 6. The Link Packet Scheduler as claimed in claim 5, wherein said Flow Control 

2 Total Block Sent (FCTBS) field and said Flow Control Credit Limit (FCCL) field are used to 

3 guarantee that data is never lost due to lack of receive buffer at each end of a physical link. 

1 7. The Link Packet Scheduler as claimed in claim 1, wherein said programmable 

2 Q utilization threshold is set such that the receive buffer has multiple data packets pending 

3 j =9 processing. 



lis 8. A data network, comprising: 

2 q a host system having a host- fabric adapter; 

3 i'U at least one remote system; 

4 1 3 a switch fabric which interconnects said host system via said host- fabric adapter to said 

5 remote system along different physical links for data communications; and 

6 one or more communication ports provided in said host-fabric adapter of said host system 

7 each port including a set of transmit and receive buffers capable of sending and receiving data 

8 packets concurrently via respective transmitter and receiver at an end of a physical link, via said 

9 switched fabric, and a flow control mechanism utilized to prevent loss of data due to receive 

10 buffer overflow at the end of said physical link. 
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1 9. The data network as claimed in claim 8, wherein said flow control mechanism is 

2 configured to support flow control through multiple virtual lanes VLs on the given port and to 

3 perform: 

4 determining when a Link State Machine transitions into one of a Linklnitialize state, a 

5 LinkArm state and a LinkActive state, or when a configuration strap for enabling loopback 

6 operation changes states; 

7 □ if the Link State Machine transitions into one of the Linklnitialize state, the LinkArm 

8 j iS state and a LinkActive state, or when the configuration strap for enabling loopback operation 

9 l H changes states, scheduling a link packet transmission for all supported virtual lanes VLs on a 

10 [ p given port; 

1 1 □ if the Link State Machine does not transition into one of the Linklnitialize state, the 

12 fU LinkArm state and a LinkActive state, or when the configuration strap for enabling loopback 

IT* 

13 j =3 operation does not change states, determining whether a Link Packet Watchdog Timer per 

14 virtual lane VL has expired; 

is if the per VL Link Packet Watchdog Timer has expired, scheduling a link packet 

16 transmission for that virtual lane VL; 

17 if the per VL Link Packet Watchdog Timer has not expired, determining whether a 

18 receive buffer utilization indicating a data storage level of the receive buffer exceeds a 

19 programmable utilization threshold; 

20 if the receive buffer utilization exceeds the programmable utilization threshold, 

21 prohibiting the link packet transmission for that virtual lane VL; 
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1 if the receive buffer utilization does not exceed the programmable utilization threshold, 

2 determining whether free credits accumulated exceeds a programmable credit threshold; 

3 if the free credits accumulated exceeds the programmable credit threshold, scheduling a 

4 link packet transmission for that virtual lane VL; and 

5 if the free credits accumulated does not exceed the programmable credit threshold, 

6 prohibiting the link packet transmission for that virtual lane VL. 



1 i;g 10. The data network as claimed in claim 9, wherein each of said credits is 64-bytes 

2 !j* from the receive buffer, and said credits are relinquished when data packets are removed from 
3 the receive buffer and that space is reclaimed as available for packet storage, or when link 

4 1 3 packets are received whose Flow Control Total Bytes Sent (FCTBS) fields differ from actual 

5 ry blocks received (ABR) at the given port. 

: 'Tit 
•;: 3 

r3 

: 

1 11. The data network as claimed in claim 8, wherein said flow control mechanism 

2 contains a Link Packet Scheduler per virtual lane (VL) arranged to schedule a link packet 

3 transmission for that virtual lane VL. 

1 12. The data network as claimed in claim 1 1, wherein said Link Packet Scheduler 

2 comprises: 

3 a N-bit counter arranged to accumulate free credits relinquished, when a data packet is 

4 removed from a receive buffer and that buffer space is reclaimed as available for data packet 
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1 storage, or when a link packet is received whose Flow Control Total Bytes Sent (FCTBS) field 

2 differs from actual blocks received (ABR) at the given port; 

3 a first comparator arranged to make comparison between accumulated free credits from 

4 the N-bit counter and a programmable credit threshold; 

5 a second comparator arranged to make comparison between a current buffer receive 

6 utilization indicating a data storage level of the receive buffer and a programmable utilization 

7 Q threshold; and 

8 j 3 a logic device arranged to track the current link state of the corresponding port, to 

9 j jf monitor the amount of receive buffer resources from the first and second comparators and to 

j" a 
•' :i=f 

!;;£ 

10 ; * schedule the transmission of a link packet, via a physical link. 

1 ry 13. The data network as claimed in claim 12, wherein said logic device comprises: 

2 K3 a first OR gate arranged to track whether a Link State Machine transitions into one of the 

3 Linklnitialize, the LinkArm and the LinkActive state, whether a configuration strap for enabling 

4 loopback operation changes states, and whether a per-VL Link Packet Watchdog Timer expires 

5 at a predetermined symbol time, and to produce therefrom a logic signal; 

6 an AND gate arranged to logically combine outputs of the first comparator and the 

7 second comparator and to produce a logic signal; and 

8 a second OR gate arranged to logically combine the logic signals from the first OR gate 

9 and the AND gate and to produce an indication for transmission of the link packet for the virtual 

10 lane (VL) on the given port. 
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14. The data network as claimed in claim 12, wherein said Link Packet Watchdog 
Timer is utilized to ensure that at minimum link packets will be independently scheduled at least 
once every 65,536 symbol times in accordance with the InfiniBand™ specification. 

15. The data network as claimed in claim 12, wherein each of said credits is defined 
;3 to be 64-bytes of available receive buffer space. 

16. The data network as claimed in claim 12, wherein said link packet contains at 

;=? 
i 

I least a Flow Control Total Block Sent (FCTBS) field which is generated by the transmitter logic 
>3 and is set to the total number of blocks (64 bytes) transmitted since link initialization, and a Flow 
U Control Credit Limit (FCCL) field which is generated by the receiver logic and is used to grant 

:M 

□ transmission credits to the remote transmitter. 

17. The data network as claimed in claim 16, wherein said Flow Control Total Block 
Sent (FCTBS) field and said Flow Control Credit Limit (FCCL) field are used to guarantee that 
data is never lost due to lack of receive buffer at each end of a physical link. 

V 

18. The data network as claimed in claim 12, wherein said programmable utilization 
threshold is set such that the receive buffer has multiple data packets pending processing. 
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1 19. A method of flow control of a link packet in a host-fabric adapter installed in a 

2 data network, comprising: 

3 determining when a Link State Machine transitions into one of a Linklnitialize state, a 

4 LinkArm state and a LinkActive state, or when a configuration strap for enabling loopback 

5 operation changes state; 

6 if the Link State Machine transitions into one of the Linklnitialize state, the LinkArm 



i □ state and a LinkActive state, or when the configuration strap for enabling loopback operation 

8 IB changes states, scheduling transmission of a link packet for all supported virtual lanes VLs on a 

9 i'U given port; 



10 |! !! if the Link State Machine does not transition into one of the Linklnitialize state, the 

n LinkArm state and a LinkActive state, or when the configuration strap for enabling loopback 

12 m operation does not change states, determining whether a Link Packet Watchdog Timer per 

n Q virtual lane VL has expired; 

14 if the per VL Link Packet Watchdog Timer has expired, scheduling transmission of a link 

is packet for that virtual lane VL; 

16 if the per VL Link Packet Watchdog Timer has not expired, determining whether a 

17 receive buffer utilization indicating a data storage level of the receive buffer exceeds a 
is programmable utilization threshold; 

19 if the receive buffer utilization exceeds the programmable utilization threshold, 

20 prohibiting transmission of a link packet for that virtual lane VL; 
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1 if the receive buffer utilization does not exceed the programmable utilization threshold, 

2 determining whether free credits accumulated exceeds a programmable credit threshold; 

3 if the free credits accumulated exceeds the programmable credit threshold, scheduling 

4 transmission of a link packet for that virtual lane VL; and 

5 if the free credits accumulated does not exceed the programmable credit threshold, 

6 prohibiting transmission of a link packet for that virtual lane VL. 

1 ;;o 20. The method as claimed in claim 19, wherein each of said credits is 64-bytes from 

== 

2 i'U the receive buffer, and said credits are relinquished when data packets are removed from the 

3 V Z receive buffer and that space is reclaimed as available for packet storage, or when link packets 

4 are received whose Flow Control Total Bytes Sent (FCTBS) fields differ from actual blocks 

5 ry received (ABR) at the given port. 

1 21. The method as claimed in claim 19, wherein said Link Packet Watchdog Timer is 

2 utilized to ensure that at minimum link packets will be independently scheduled at least once 

3 every 65,536 symbol times in accordance with the InfiniBand™ specification. 

1 22. The method as claimed in claim 19, wherein each of said credits is defined to be 

2 64-bytes of available receive buffer space. 
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23. The method as claimed in claim 19, wherein said link packet contains at least a 
Flow Control Total Block Sent (FCTBS) field which is generated by the transmitter logic and is 
set to the total number of blocks (64 bytes) transmitted since link initialization, and a Flow 
Control Credit Limit (FCCL) field which is generated by the receiver logic and is used to grant 
transmission credits to the remote transmitter. 

24. The method as claimed in claim 19, wherein said Flow Control Total Block Sent 
(FCTBS) field and said Flow Control Credit Limit (FCCL) field are used to guarantee that data 
is never lost due to lack of receive buffer at each end of a physical link. 

25. The method as claimed in claim 19, wherein said programmable utilization 
threshold is set such that the receive buffer has multiple data packets pending processing. 
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